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ABSTRACT 

Most  extant  approaches  to  risk  assessment  stress 
methodological  and  procedural  solutions  to  the  problem 
because  method  and  procedure  are  viewed  as  bulwarks  >.■  :■  : 
fallibilities  and  limitations  of  human  _udgrr»nt.  .  .  i;  • 

examines  the  other  side  of  that.  coin,  the  use  of  '  i 

intuition  as  bulwarks  against  the  f al 1 ibil it ies  and  . »-  •  i* 
of  formal  methodology.  Those  :  imitations  are  describe.; 
capabilities  which  judgment  and  intuition  provide  t 
for  them  discussed.  The  paper  calls  for  a  greater  .y:  : t  • 
judgment  and  methodology,  in  which  they  aid  and  suppa’  n. 
other  instead  of  competing. 
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RISK  ASSESSMENT  AS  A  SUBJECTIVE  PROCESS* 


INTRODUCTION 

In  one  form  or  another,  risk  assessment  problems  occur  in 
all  phases  of  defense  planning  and  public  policy  analysis  more 
generally.  There  are  numerous  extant  approaches  to  the 
assessment  of  risk,  including  fault  and  event  tree  analysis, 
actuarial  techniques  of  various  kinds,  and  a  variety  of  methods 
based  to  differing  degrees  on  ideas  derived  from  statistical 
decision  theory.  (Each,  of  course,  is  applicable  to  only  certain 
types  of  problems.)  All  these  approaches  are  what  1  will  call 
"method  oriented"  in  the  sense  that  they  stress  formal 
methodology  or  technique.  They  treat  risk,  however  they  define 
it  as  something  inherent  in  the  problem  being  analyzed,  arid 
propose  formal  methods  and  procedures  to  get  at  and  measure  that 
risk.  The  idea  that  human  judgment  is  seriously  flawed  and  that 
methodology  and  technique  should  serve  as  bulwarks  against  its 
fallibilities  and  limitations  seems  to  provide  a  major  rationale 
for  this  general  orientation. 

Considerable  evidence  can  be  marshalled  to  support  this 
rationale.  The  psychological  literature  abounds  with  experiments 
illustrating  the  fallibilities  of  human  judgment,  and  it's  easy 
to  find  we  1 1 -documented  examples  of  serious  errors  in  judgment  by 
high  public  officials.  No  wonder,  then,  that  in  matters  of 
consequence  we  have  come  to  distrust  "judgment  alone"  and  to  seek 
less  hazardous  ways  of  understanding  the  world. 

•'■Thin  ;  -  it.  e«i ;  ted  version  d  i  :  i k  ;  •  ese;,:  ,«(1  at  the  94th  Military 
•;>er  d.  :-.es  ears':,  Syr.  os  :  n:  “  KS  r.  :•  nuiberg  AFB,  Dec.  5,  1979. 


|  But  formal  method  and  tticlmiquo  liave  limits  of  their  own  -- 

■  and  very  serious  limits  --  which  are  often  neglected  bv  their 

; 

most  ardent  advoc.  tes.  My  focus  here  will  he  on  that  side  of  the 
coin,  and  on  the  use  oi  intuit  ice,  and  aih  in  :  ive  judgment  as 
bulwarks  against  the  fallibilities  and  1  irr.it.it  i  on  s  of  formal 
met hoilo  iogv  . 

Some  interpret  any  critique  oi  quant i 1 ai  ive  methodology  as 
an  all-out  attack  --  a  plea  to  throw  analysis  away  and  to  go  back 
to  astrology  and  the  reading  of  entrails.  That  would  throw  the 
baby  out  with  the  hath  Water,  ind  that’s  not  what  I'm  advocating 
at  all.  We  went  too  far  once  before,  in  the  other  direction, 
when  the  "McNamara  Revolution"  made  methodology  king  and 
"judgment."  a  dirty  word.  We're  still  recovering  from  those 
excesses,  and  it  would  be  a  mistake  to  swing  too  far  the  other 
►  way.  What  we  need  instead  is  a  real  synthesis  of  methodology  and 

judgment  in  which  they  aid  and  support  each  other  instead  of 
compet ing . 

Good  analysts  do  this,  of  course,  and  always  have.  Good 
analysis  depends  on  just  such  a  synthesis.  But  it's  done  now  in 
spite  of  our  paradigms  for  analysis  and  our  conventions  for 
thinking  and  talking  about  it,  rather  than  because  of  those 
conventions  and  paradigms.  Those  get  in  the  way  too  often,  and 
discourage  rather  than  encourage  good  analysis.  1  believe  we 
need  to  reshape  those  conventions  and  paradigms  to  encourage  the 
synthesis  and  make  it  a  more  common  and  consistent  part  of  our 
planning  processes.  To  do  this,  we  need  better  understanding 
than  we  now  have  o|  the  limits  of  our  methodologies  and  of  the 
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separate  tole  and  value  of  judgment  and  intuition.  We  can't  get 
this  if  we  always  play  one  off  against  the  other  and  interpret 
criticism  of  formal  analysis  as  an  attack  to  he  defended  against 
at  all  costs. 

This  paper  will  explore  the  nature  of  risk  assessment  at  a 
general  conceptual  level.  1  want  to  look  particularly  at  the 
subjective  aspects  of  the  problem  and  at  the  limitations  of 
methodological  and  procedural  solutions.  1  will  then  outline 
complementary7  characteristics  of  judgment  and  intuition  and 
suggest  directions  in  which  the  synthesis  we  should  strive  to 
reach  might  be  found. 

1  will  use  the  term  "risk  assessment"  to  broadly  encompass 
problems  of  trving  to  andei stand  and  foresee  potentially 
dangerous  consequences  if  future  situations  or  potential  courses 
of  action.  With  this  ’oread  definition,  risk  assessment  is  an 
important  component  oi  most  ot  problems  of  policy  or  program 
choice.  Accordingly,  most  of  what  !  say  will  apply  to  analysis 
in  general ,  as  well  as  to  the  particular  narrow  sub-domains  often 
labeled  as  risk  analysis  per  se . 

If  you’ve  given  much  thought  at  a  1 !  to  these  issues,  much  of 
what  1  say  should  seem  obvious.  In  a  sense  it.  is,  but  somehow  we 
cion '  t  pay  enough  attention  to  it.  I'm  going  to  try  to  take  a  lot 
of  individually  familiar  pieces,  put  them  together  in  an  overall 
pattern  you  may  not  have  fitted  them  into  before,  and  explore 
some  of  the  implications  of  that,  pattern.  I.ven  if  I  don  t  show 
vo.  mvtl.irig  new ,  1  Iv  give  you  a  better  understanding  of 

son*’  of  1 1 .  •  ■  things  yon  i!  ready  know  but  :n  iv  not  often  think  very 
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THE  METHOD  ORIENTED  APPROACH  TO  KNOWING 

I  first  want  to  develop  a  general  character  iz.it  ion  of  what  I 
earlier  called  method  oriented  approaches  to  risk  assessment.  At 
some  level  this  character  i/.at  i  >n  in  tact  applies  to  all  formal 
approaches  to  knowing,  including  si ience.  I'm  not  saying  that 
method  oriented  approaches  never  work  --  their  successes  in  the 
physical  sciences  and  engineering  are  clear  testimony  that  they 
often  do.  But  they  don't  always  work,  and  it's  important  to  be 
able  to  distinguish  between  when  they  do  and  when  they  don't. 

All  method  oriented  approaches  work  on  and  within  the 
context  of  a  well-defined  model,  in  the  manner  illustrated  in 
Figure  1.  The  model  is  treated  as  the  problem,  and  the  problem 
is  identified  with  the  model.  Results  derived  from  the  mode]  are 
interpreted  as  conclusions  about  the  problem  itself  (perhaps  to 
within  some  fixed  numerical  error),  assuming,  in  effect,  that  the 
problem  structure  matches  or  comes  very  close  to  that  of  the 
model.  "Risk"  is  seen  as  an  objective  attribute  of  the  problem  to 
be  uncovered,  measured,  and  quantified  through  its  counterpart  in 
the  model  . 


Figure  1 
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In  this  paradigm,  the  risk  assessor  plays  a  conceptually 
passive  role.  He  uncovers  and  brings  out  what  is  already 
inherent  in  the  problem,  but  he  is  riot  thought  of  as  playing  an 
active  role  in  bringing  structure  to  the  problem  and  perceiving 

i 

and  defining  the  nature  of  the  risk  within  that  structure.  His 
conceptual  role  is  very  much  like  the  one  we  attach  to  the 
scientist  --  the  independent  objective  observer  who  stands 
separate  and  apart  from  the  process  which  he  studies  and 
invest i gates . 

This  paradigm  --  the  model  identified  with  the  problem,  the 
analyst  and  objective  independent  observer  --  often  works  very 
well.  it  is  particularly  useful  in  problems  involving  well- 
defined  and  we  1 1 -understood  systems  and  processes,  such  as  the 
kind  of  actuarial  risk  assessment  problems  faced  by  insurance 
companies,  or  reliability  analyses  of  engineering  systems  based 
on  we  1 1 -understood  physical  principles.  It  works,  in  other 
words,  in  areas  in  which  the  models  used  have  been  subject  to 
stringent  acceptance  criteria  and  strong  peer  review.  It  is 
these  conditions,  in  fact,  which  give  the  paradigm  its  very 
considerable  utility  ir.  science  generally. 

This  paradigm  works  less  well,  however,  in  ill-defined  and 
poorly  understood  problems,  in  one  of  a  kind  systems,  or  in  new 
environments  for  which  generally  accepted  and  thoroughly 
validated  models  do  not  exist.  Hut  this  is  exactly  the  kind  of 
problem  which  occurs  ! re-piem 1 v  in  defense  and  other  forms  of 
public,  policy  ,ia  ilvse  --  issess  t  :ig  the  risks  assocated  with  a 
new  strutegi  svc.-::.  ;  •  ..  .  .  o:  tin  «  :.v  i  ronmental  risks  of 

title  le-|.  ;j  .kI'V 


With  these  kinds  of  problem,  the  relationship  between  the 
s uhs t an t  : \ .■  problem  and  the  mode  I  used  ti  ana  ly/.e  it  .  s  generally 
more  complex  and  tenuous  than  the  <  h.ira-.t .  l  iz.it  ion  deplete  :  in 
F  >'  jjnre  ’  suggest  s  .  ".'in  siibsiantiv  problem  is  likely  t;  t  :  j « •  r 

1. -.i:e  ;di  i  .ibit  !  :  nit  tie-  mode  i  There  ..ill  f;ene  r  a  i  l '.  be  ■  .  j ,  i  ,r« 
1  avers  :  ..nuniat  io:i ,  s  ;  :np !  1 1  i  at  ion  ,  and  rede!  ;  t  :<  a  a-  wi 
pro!.-!  ei.  ind  .no.ie’.  .  necessitating  correspond  ing  layers  nj 
interpret  ai  ion  between  analytical  results  u:d  suiis  t  ant  ;  ve. 
conclusions.  Tit  i  s.  situation  is  depicted  schematically  in  Figure 

2.  Any  substantive  conclusions  drawn  from  analysis  must 
necessarily  be  mediated  by  these  processes  of  formulation  i moving 
down  the  left  side  of  Figure  2)  and  interpretation  (moting  up  the 
right).  Yet  methodology  deals  only  with  the  relationship  between 
model  and  results  (the  line  along  the  bottom)  and  method  oriented 
approaches  tend  to  neglect  the  things  which  go  on  elsewhere 

( Strauch  1974) . 


Figure  2 
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ln  this  sort  ol  situation,  the  role  of  the  assessor  must 
necessarily  he  ditterent  from  tliat  described  above.  He  can  no 
longer  play  the  independent  observer  standing  apart  from  and 
above  a  well-defined  problem  "out  there."  Rather,  he  is  himself 
a  part  of  the  process  which  articulates  the  problem,  brings  it 
into  focus,  and  distinguishes  it  from  the  surrounding 
environment.  His  subjective  judgment  plays  a  critical  role  which 
cannot  be  diminished  by  appeals  to  procedure  and  method.  Too 
much  dependence  on  procedure  and  method,  in  fact,  may  get  in  the 
way,  acting  to  inhibit  rather  than  to  encourage  good  risk 

assessment  by  drawing  attention  away  from  risks  which  fall 

k 

outside  the  scope  of  the  methodology. 

It.  is  worth  noting  in  passing  that  while  these  criticisms 
are  directed  primarily  at  the  uncritical  application  of  formal 
quantitative  techniques,  they  apply  equally  well  to  the 
uncritical  application  of  less  formal  methods  and  procedures  as 
well.  Any  assessment  based  on  a  rote  procedural  analysis  of  a 
consensual  model  is  subject  to  the  same  pitfalls,  whether  the 
underlying  model  is  quantitative  or  qualitative,  formal  or 
informal.  See  Straucli  11971)  for  an  example  of  this  in  a 
nonforma  1  situation. 

A  PERCEPTUAL  PARADIGM  FOR  ANALYSIS  AND  RISK  ASSESSMENT 

1  now  want  to  outline  an  alternative  view  of  analysis  (and 
risk  assessment  in  particular)  as  a  form  of  organizational 
perception,  md  reexamine  these  questions  in  the  light  of  that 
view.  Analysis  may  be  seen  as  a  process  through  which  an 


organ iz  it  ion  perceives  and  understands  its  environments  in  the 
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same  way  that  vision  is  a  process  through  which  individual  human 
beings  perceive  and  understand  theirs.  The  parallels  between 
vision  and  analysis  are  quite  strong,  and  I  will  draw  on  them 
repeatedly.  Some  are.  dismissed  in  greater  detail  in  (Strain. h 
1974),  while  tin'  nature  ol  pert.eptual  processes  m  general  and 
visual  perception  in  particular  is  discussed  m  i Si  much, 
forthcoming) . 

A  central  tenet  oi  this  perceptual  paradigm  is  that  "the  map 
ts  not  the  terrain."  The  visual  image  is  not  the  object  and  the 
model  is  not  the  problem  being  modeled.  The  visual  image  or  the 
analyst's  model  are  only  s.npliiied  i  eprese;.:  at  ions  of  the 
external  reality  they  represent,  and  the  perm  i vet  or  analyst  who 
makes  those  simplifications  must  use  them  act  ordingly . 

In  the  visual  case,  it’s  clear  that  the  image  is  not  the 
object  simply  from  the  difference  in  dimensionality.  An  object 
is  a  three-dimensional  space-* i 1 i ing  thing,  while  any  visual 
image  of  it  is  necessarily  flat  and  two-dimensional.  As  Figure  3 
illustrates,  the  same  object  may  look  very  different  from 
different  perspectives,  each  showing  some  aspects  of  the  object 
and  biding  others.  No  single  particular  perspective  can  be  said 
to  be  "best'  in  any  absolute  sense.  So  it  is  with  models  of 
complex  weapon  systems,  pol it ical/mi 1 i t  ary  interactions,  or 
social  programs.  Any  complex  real  world  problem  will  always  have 
more  dimensions  and  a  greater  richness  than  any  single  model  can 
capture,  and  different  models  will  capture  different  aspects  just 
as  different  perspectives  show  ditterent  aspects  ol  a  phvsical 
object.  There  is  unlikely  to  be  .u.y  single  "best"  model,  and 


I 


apparently  contradictory  models  may  seem  that  way  only  because 
they  capture  different  dimensions  of  the  problem.  In  modeling 
squishy  and  ill-defined  problems,  the  nature  of  the 
s imp  1 i f  i  cat  ions  made  must  be  kept  in  mind  when  interpreting  any 
results  obtained. 


Figure  3 

kb:  I  some  of  trie  d  :  f  !  “  rences  between  pronle-  ml  mo  io  1  can 
be  seei.  bv  lnalogy  with  two  dimensional  images  of  three 
dimension  il  objects,  the  issue  is  not  simply  one  of  perspective 
Kid  dimensionally.  The  particular  problem  aspects  included  in 
the  mode!,  uni  the  ways  these  aspects  are  represented  and 
inter  re’,  ited,  depend  on  i.ho  ices  made  by  the  ana  1  vs  t  i  or  bv  the 
me  t  hodo  !  ogv  be  uses).  Sot  1  1  1  these  choir.es  H‘e  ext.  !  1  :t  ;'l 
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But  if  we  can  see  things  in  more  than  one  way,  we  can  also 
see  them  the  wrong  way.  We  can  fail  to  see  things  that  are  right 
in  front  of  our  eyes,  or  can  imagine  we  see  things  that  are  not 
really  there.  One  of  my  favorite  demonstrations  of  the  first 
possibility  is  an  experiment  in  which  playing  cards  were  flashed 
before  subjects'  eyes  at  speeds  which  allowed  them  to  be 
identified  but  not  carefully  examined.  A  few  cards  were  the 
wrong  color  --  a  red  six  of  spades,  for  example.  Subjects  just 
failed  to  notice  this  anomaly.  Some  saw  an  ordinary  six  of 
spades  and  others  a  six  of  hearts,  depending  on  whether  they 

responded  to  the  shape  or  color  cue.  At  longer  presentation 

« 

intervals  they  began  to  become  uncomfortable  about  the  anomalous 
cards,  though  without  knowing  why.  At  still  longer  intervals 
they  were  able  to  see  the  card  as  it  was  and  make  the  correct 
identification.  Once  they  had  done  that,  they  could  correctly 
identify  anomalous  cards  at  the  shorter  intervals,  because  they 
now  had  perceptual  categories  in  which  to  place  those  cards 
(Brunner  and  Postman,  1949). 

Figure  5  shows  an  example  of  the  second  possibility,  of 
seeing  something  that  isn't  really  there  at  all.  Most  people 
clearly  see  a  solid  white  triangle  resting  on  top  of  a  biack- 
origed  triangle  and  three  black  circles,  even  though  there's  no 
white  triangle  there  at  all  objectively.  Its  edge  is  clearly 
visible,  though  there's  no  objective  stimulus  in  the  figure  to 
provide  such  an  edge.  This  illusion  seems  to  come  from  the  fact 
that  we  normally  to  perceive  a  world  in  which  visual  patterns  are 
caused  by  physical  objects,  so  we  create  "oh  ,ects"  (in  this  case 
the  triangles  mb  circles  I  to  explain  the  vi.su  i!  citterns  we  see 
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Figure  5 

The  point  of  all  this  is  that  our  souse  of  vision,  which  wo 
iio[)ond  upon  to  umiors Land ,  deal  with,  and  even  suivivo  :!i  the 
environment  we  i ive  in  is  a  far  more  complex  process  than  ue  are 
conscious  of  most  of  the  Lime.  The  same  is  true  of  the  processes 
of  organizational  perception  to  which  risk  assessment  and  other 
iorms  of  planning  and  analysis  contribute.  By  thinking  more 
carefully  than  we  usually  do  about  how  well  our  vision  works  and 
how  we  use  it,  we  can  perhaps  see  these  organizational  processes 
more  clearly  as  well,  and  better  understand  their  limitations  and 
the  pitfalls  that  go  with  them. 

The  above  examples  illustrate  the  fact  that  our  use  of 
vision  to  know  and  react  to  the  world  around  us  is  a  two  stage 
process.  The  first  stage,  of  which  we  art  barely  conscious, 
involves  bringing  the  world  into  focus  in  a  meaningful  way.  We 
do  this  by  selecting  appropriate  cues  from  the  tumbled  and 
•  h.K.t  sc  visual  flow  which  crosses  our  retinas,  and  asset:!',  tug 

•a«'..  u  :  1 1 .  >  ltd  of  t  it  ti  i.  u.-i  past  i-\;«  :  :  •  <• ,  :  t.t  i 
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t ho  images  we  consciously  see  as  the  world  "out  there."  Only  once 
we  have  done  this  can  we  engage  in  more  conscious  processes 
through  which  we  use  that  information  to  cross  the  street,  re. id 
and  answer  the  mail,  or  eat  lunch.  The  first  stage  operates 
reliably  most  of  the  time,  so  it  makes  sense  to  ignore  it.  When 
it  does  tail,  however,  it  can  have  disasterous  consequences ,  as 
in  the  case  of  a  hunter  shooting  another  hunter  he  mistakes  for  i 
dee r . 

Risk  assessment  and  other  forms  of  problem  solving  likewise 
involve  two  stages,  a  focusing  stage  and  an  analysis  stage.  In 
tile  focusing  stage,  the  problem  is  brought  into  focus  in  a  way 
that  defines  the  issues  and  makes  the  answer  being  sought 
meaningful.  This  is  the  modeling  process,  and  corresponds  to  the 
subconscious  process  which  creates  our  visual  images.  Once  this 
is  done,  the  model  thus  defined  may  be  subjected  to  quantitative 
risk  assessment  or  other  forms  of  analysis.  Both  of  these  stages 
are  critical  to  the  quality  of  any  conclusions  eventually 
reached .  From  this  perspective,  the  weakness  of  method  oriented 
approaches  is  that  by  prescribing  methods  and  procedures  within 
the  context  of  a  well-defined  model,  they  limit  attention  to  the 
analysis  stage  only  and  shortchange  the  focusing  process . 

Neglect  of  this  focusing  stage  may  not  matter  when  a 
reliable  consensus  exists  on  the  nature  of  the  model.  This  is 
the  case,  for  example,  in  the  hard  sciences  and  much  of 
engineering,  and  in  areas  such  as  actuarial  risk  assessment  for 
insurance  purposes.  But  without  a  reliable  consensus,  ign<  ting 
tie  t'.-'r-i:.,:  •  t  i;;e  u.  |e  misleading  and  dniigi  Mills  .  1::  the 
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presence  of  an  unreliable  consensus,  the  opportunity  for  serious 
error  is  obvious,  and  we  each  have  our  own  favorite  examples  of 
erroneous  risk  assessments  in  such  circumstances.  Two  which  come 
to  mind  are  assessments  by  the  U.S.  intelligence  community  that 
the  Shah  of  Iran  would  not  fall  from  power,  based  on  a  consensus 
that  religion  was  not  a  major  force  in  political  change,  and  the 
risk  assessment  for  the  mission  on  which  the  U . S . S .  Pueblo  was 
seized  in  1968,  which  depended  heavily  on  the  consensus  that 
vessels  in  international  waters  would  not  be  attacked  (Strauch, 
1971) . 

In  the  absence  of  any  real  consensus,  reliable  or  not,  on 
the  substantive  model  on  which  to  base  analysis,  reliance  on  a 
method  oriented  approach  and  neglect  of  the  focusing  stage  can 
restrict  attention  to  the  particular  class  of  models  called  for 
by  that  approach.  Give  the  problem  to  an  analyst  committed  to  a 
particular  methodology  and  you  are  almost  certain  to  find  it 
structured  in  a  way  which  ignores  those  aspects  of  the  problem 
not  considered  by  that  methodology.  As  the  saying  goes,  "to  a 
small  boy  with  a  hammer,  everything  looks  like  a  nail." 

Restricting  attention  to  particular  models  or  classes  of 
models  can  also  make  it  difficult  to  surface  unconventional 
views,  or  to  get  serious  attention  to  aspects  of  the  problem 
which  the  existing  consensus  does  not  consider.  The  surfacer  is 
faced  with  difficulties  akin  to  those  of  trying  to  raise  the 
issue  of  whether  the  faces  in  Figure  4  are  young  or  old  among 
people  who  see  only  the  vase,  and  can  be  easily  dismissed  as  a 
flaVe  who  doesn't  understand  the  "real  problem."  This  can  have 
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advantages,  of  course,  in  an  organizational  decisionmaking 
context.  It  keeps  people  in  line,  and  limits  the  scope  of 
debate.  These  are  real  advantages,  not  to  be  written  off 
lightly.  If  all  organizational  decisionmaking  had  to  proceed 
from  first  principles,  little  would  ever  get  done. 

But  is  it  worth  the  price?  Is  the  extra  efficiency  obtained 
from  a  narrow  and  restricted  focus  worth  the  risk  of 
underestimating  or  overlooking  altogether  something  which  falls 
outside1  that  focus?  The  answer  to  that,  unfortunately,  must  be 
"it  depends."  Sometimes  it  is  and  sometimes  it  isn  t,  depending 
on  how  things  happen  to  work  out.  The  question  of  how  much 
effort  should  be  spent  on  broadening  focus  and  searching  for  and 
evaluating  consequences  which  might  otherwise  be  missed  is  itself 
an  institutional  or  social  choice,  and  one  we  have  been  making 
increasingly  in  the  direction  of  more  broadly  focused  risk 
assessments  in  recent  years.  The  Environmental  Impact  Statement 
is  an  example  of  this  trend.  It  doesn't  always  work  as  well  as 
it  might,  of  course,  but  it  does  represent  a  clear  attempt  by  the 
Congress  to  force  broader  consideration  of  the  potential 
consequences  of  government  programs  of  all  kinds  than  those 
programs  would  otherwise  be  likely  to  receive. 

WHERE  DOES  JUDGMENT  COME  IN? 

At  one  level,  most  of  what  I've  said  seems  to  sum  up  to 
"choose  the  wrong  model  and  you  get  the  wrong  answer,"  and 
there's  nothing  very  profound  about  that.  Is  there1  really 
anything  more  than  that  going  on,  anything  more1  to  the1  use  of 
•udgment  and  intuition  than  the  simple  idea  that  smart  people  are 
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more  likely  to  choose  the  right  models  land  thus  get  right 
answers)  than  dumb  ones? 

I  think  there  is.  The  map  is  never  the  terrain,  but  people 
know  the  difference,  and  routinely  use  maps  to  help  them 
understand  terrain  without  becoming  confused  about  it.  Most 
people,  in  fact,  can  use  several  different  maps  of  the  same 
terrain,  drawing  topographical  information  from  one,  political 
information  from  another,  etc.,  to  create  a  richer  composite 
understanding  of  that  terrain  than  is  contained  on  any  of  the 
naps  individually.  The  human  mind  can  function  on  many  levels 
simultaneously,  and  can  integrate  knowledge  across  those  levels. 
Explicit  models,  on  the  other  hand,  are  fixed  .at  one  particular 
level,  like  one  particular  map,  and  formal  methods  and  techniques 
based  on  such  models  are  similarly  limited. 

Its  probably  worth  mentioning  here  that  when  1  talk  about 
judgment,  l'm  not  talking  about  off  the  wall  opinions  given  at 
the  drop  of  a  hat.  Too  often,  the  term  "judgment"  is 
uncritically  applied  to  any  opinion  anyone  has,  independent  of 
the  knowledge  and  experience  on  which  it  is  based  the  care 
which  went  into  its  formation.  There  is  good  judgment  ami  bad 
judgment,  ireful  judgment  and  sloppy  judgment.  I  am  coin. (-rued 
here  primarily  with  good  judgment,  with  what  it  sometimes  is  and  more 
»' l  mi  could  be  if  we  nourished  and  encouraged  it  properly. 
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scrutiny)  as  analogous  to  a  drawing  or  other  two  dimensional 


representation  ot  the  problem.  Just  as  there  are  many  possible 
two  dimensional  representations  of  the  same  object  --  true 
perspectives,  caricatures,  in  outline  or  with  full  detail,  in 
black  and  white  or  m  color  --  so  there  will  he  many  possible 
models  of  the  same  object.  Some  will  be  quantitative,  though  not 
all  will  quantify  the  same  aspects  of  the  problem  or  do  it  in 
quite  the  same  way.  i'thers  will  be  qualitative  --  verbal 
descriptions  of  problem  elements  and  the  relationships  between 
those  elements.  Still  others  may  he  mixtures,  quantifying  some 
aspects  ot  tin'  problem  but  still  including  aspects  not  so 
quantified.  Different  models  will  stress  and  obscure  different 
aspects  of  the  problem,  and  so  mav  a  superficially  different. 
None  will  unambiguously  capture  the  whole  problem,  any  more  than 
any  single  picture  can  unambiguously  capture  the  three 
dimensional  object  in  all  its  detail. 

Now  think  about  the  way  you  use  your  vision  to  move  through 
your  environment.  Think  about,  what  is  involved  as  you  move  past 
and  around  an  object  in  your  path,  such  as  a  chair.  At  any  point 
in  time,  you  see  some  particular  two  dimensional  image  of  the 
chair,  but  as  you  move,  that  image  changes.  The  chair  looks 
different  from  the  front,  side,  and  back,  and  if  all  you  had  to 
go  on  were  these  images,  you  would  probably  find  the  changes 
which  occur  as  you  move  very  confusing  In  fact,  you  are  hardly 
aware  of  those  changes,  and  they  are  certainly  not  confusing. 

The  reason  is  that  you  do  not  simply  respond  to  the  individual 
changing  images.  Instead,  you  respond  to  the  total  flow  of 
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images,  and  relate  that  flow  to  your  internal  understanding  (an 
internal  model,  if  you  will)  of  what  a  chair  is  and  how  its 
visual  images  behave  as  you  move  past  it. 

The  same  is  true  of  your  visual  environment  as  a  whole.  At 
any  time  you  have  a  two  dimensional  image  of  that  environment, 
but  that  image  constantly  shifts  and  changes,  even  as  you  move 
your  head  and  shift  your  eyes.  What  you  "see"  remains  remarkably 
stable  in  spite  of  these  changes,  because  you  interpret  the 
changing  images  through  a  richer  three  dimensional 
image/model/understanding  of  your  environment.  This  three 
dimensional  understanding  both  draws  from  and  gives  meaning  to 
the  individual  two  dimensional  images,  yet  is  qualitatively 
different  from  them.  It  could  never  be  reduced  to  a  two 
dimensional  image,  in  spite  of  the  fact  that  the  principal  handle 
you  have  on  it  at  any  point  in  time  is  a  two  dimensional  image. 

Human  decisionmakers  --  people  --  understand  the  kinds  of 
problems  and  choices  for  which  analysts  make  risk  assessments  in 
much  the  same  way.  They  can  integrate  information  drawn  from 
different  models  or  other  sources  into  a  composite  understanding 
of  the  issue  being  addressed  in  a  manner  similar  to  that  by  which 
we  integrate  disparate  visual  images  of  the  same  object.  Just  as 
in  the  visual  case  most  of  this  integration  takes  place  below 
consciousness,  and  it  is  some  individual  model  or  image  of  the 
problem  which  fills  consciousness  at  any  point  in  time,  rather 
than  the  composite  understanding.  But  just  as  in  the  visual  case 
these  individual  models  rest  on  and  contribute  to  the  composite 
understanding,  and  without  the  composite  understanding,  the 
individual  models  would  be  of  little  use. 
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Judgment  and  intuition  are  names  wo  i  vc  the  pi  t.c<-s.-.«*s  wi. !  ■ 
prodm  <■  and  draw  from  t  iiis  understanding,  t  i , .  process*--  w:. 
work  in- 1  ow  lie-  level  of  (.oust  lousness  to  so  lout  ,i;.d  r> 

know !  edge  from  a  v.ir  iot  v  of  sources  .md  ii-vclj  • 

iy  i-X  1  « •  Its  i  :>ns  o!  i  j  I  subi  i  lis  ’  ui.s  analogs  1<  : 

i  :\>  i-sM-s  which  t  ike  place  c:  tin-  >.i;ns>.  tons  at.  a  ly  :  .■  .  -  . 

are  !  unduniout.il  ly  differ  ent .  They  <  an  no  more  i>-  t  .•  n..  <••: 

\ erbui  or  analytical  torn;  than  our  three  dinensioual 
understanding  of  our  visual  environment  can  he  reduced  t>.  twt 
dimensional  form.  (Though,  just  as  is  the  case  with  the  v:s..  1 
understanding,  they  can  be  represented  or  partially  desci  ibed  1  y 
those  forms.)  We  lose  a  great  deal,  I  believe,  if  we  ignore  tins- 
differences  in  the  attempt  to  make  that  reduction. 

Formal  analysis  sometimes  appears  superior  to  judgment 
purely  because  of  the  apparent  ability  of  formal  methods, 
especially  when  aided  by  computers,  to  handle  far  more  detail  arid 
complexity  than  can  the  unaided  human  mind.  What's  really  going 
on,  I  think,  is  that  there  are  kinds  of  complexity  that  formal 
methods  can  handle  better  than  intuition,  and  kinds  of  complexity 
for  which  the  reverse  is  true.  But  even  for  those  kinds  which 
the  formal  methods  can  handle  better,  intuitive  understanding  is 
still  required  to  interpret  the  results  produced  by  the  formal 
methods  and  give  them  meaning  in  the  larger  context  that  is 
ultimately  always  there. 
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Hero.,  again,  the  visual  analogy  is  instructive.  Most  people 
have  a  limited  ability  to  retain  (or  at  least  to  access)  detail 
in  their  internal  visual  images.  To  see  this,  close  your  eyes 
and  try  to  picture  the  details  of  this  room.  For  most  people, 
the  detail  is  limited.  A  photograph,  on  the  other  hand,  can 
retain  large  amounts  of  detail,  and  make  it  available  when 
desired.  But  the  photograph  cannot  provide  the  sense  of 
relationships  between  elements  of  the  scene,  and  of  what  those 
elements  might  be  like  in  their  totality  rather  than  from  just 
one  perspective,  which  our  three  dimensional  understanding  of  the 
world  provides.  In  fact,  without  the  use  of  that  three 
dimensional  understanding  in  interpreting  the  details  in  the 
photograph,  the  photograph  would  be  as  likely  to  mislead  as  to 
inform. 

The  two  dimensional  photograph  can  provide  details  about  the 
object  pictured  which  our  unaided  internal  understanding  could 
not  otherwise  retain  and  cope  with,  but  only  that  internal 
understanding  can  put  those  details  in  perspective  in  a  richer 
three  dimensional  world.  The  two  together,  then,  provide  a 
richer  and  better  understanding  than  could  either  without  the 
other.  The  same  is  true  of  intuition  and  analysis,  which  is  why 
we  need  the  greater  synthesis  I  called  for  earlier. 

An  example  of  the  integrative  capability  of  the  mind  is 
shown  in  the  next  two  figures.  The  three  shapes  shown  in  Figure 
6  are  clearly  different,  and  incompatible  as  shapes  in  a  two 
dimensional  plane.  At  first  glance,  it  seems  difficult  to 
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believe  that  they  could  all  be  pictures  of  the  same  object,  since 
you  have  no  mental  image  of  such  an  object. 

A  O  □ 

Figure  6 


Now  think  about  a  cylinder  as  tall  as  it  is  wide.  It  has  a 
circular  cross  section  from  the  top  and  a  square  cross  section 
from  the  side,  providing  two  of  the  necessary  shapes.  If  its 
sides  are  beveled,  as  siiowri  in  cylinder  shown  in  Figure  7 ,  we 
obtain  an  object  with  a  triangular  cross  section  as  well.  As 
soon  as  you  have  a  mental  image  of  such  .a  beveled  cylinder,  the 
apparent  impossibility  of  a  single  object  having  all  those  shapes 
disappears.  Thus  what  was  irreconcilable  on  the  level  of  the 
picture  becomes  clearly  reconcilable  on  the  level  of  the  object. 


Figure  7 
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Thore  is  another  analogy  between  vision  and  risk  assessment 
which  is  also  worthy  of  mention.  We  really  have  not  one  visual 
system  but  two  --  a  central  fovea  1  vision  which  provides  sharp 
detail  in  a  small  area  in  the  center  of  the  visual  field,  and  a 
softer  peripheral  vision  which  provides  less  detail  across  a  much 
broader  field.  Without  the  former  we  would  be  unable  to  perform 
many  important  tasks,  such  as  reading,  recognizing  faces  at  a 
distance,  or  driving.  But  we  would  not  bo  able-  to  function  very 
well  without  the  latter  either.  With  no  peripheral  vision,  we 
could  still  read  and  recognize  faces  at  a  distance,  but  driving 
would  become  exceedingly  dangerous  and  just  getting  around  would 
become  much  more  difficult.  We  need  both  central  and  peripheral 
vision  to  function,  a  need  that  is  recognized  in  the  fact  that 
someone  missing  e  ither  is  considered  legally  blind. 

Formal  methods  and  procedures  are  a  lot  like  foveal  vision. 
They  are  very  good  at  examining  detail  in  a  narrow  and  restricted 
area  with  sharply  defined  edges.  They  have  no  peripheral 
capabilities,  though,  no  ability  to  notice  the  stuff  mound  the 
edges.  Yet  is  is  often  on  the  edges,  beyond  the  boundaries  of 
the  assumptions  of  consensus  and  conventional  wisdom,  that  the 
important  threats  lie.  Judgment  and  intuition,  oti  the  other 
hand,  are  more  like  peripheral  vision  --  softer,  less  sharp,  but 
covering  a  much  broader  area.  In  problems  of  risk  assessment, 
then,  they  serve  as  the  peripheral  complement  to  more  fovea’ 
formal  methods.  Without  that  complement,  we  are  m  the  same 
position  as  someone  with  tunnel  vision  --  we're  !i:ie  is  long  is 
we  always  look  in  the  right  direction,  but  missing  the  very 
faculties  we  need  to  guide  that  looking. 
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r.viM.  :!  i  idgiu-n .mi  intuit  ion  do  give  us  l  und  imenl  a  1  1  y 
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Dei  me  reiterate  tint  none  of  this  implies  that  we  should 
ih.r.siou  form  1 1  met  hods  and  at.ulyt  ic  tools.  We  need  them,  bat  we 
need  intuition  and  judgment  as  we  1 1  .  1  he  major  impi  icat  ion  ot 

what  I've  said  above  is  that  we  need  to  work  tor  i  belter 
synthes  is  of  hot!,  ways  of  knowing,  ii.  which  each  j  ids  and 
supports  the  other  instead  ot  compel,  ing  with  it. 

Karl icr  i  characterized  problem  solving  as  a  two-st  .jge 
process,  consisting  of  a  focusing  stage  and  an  analysis  stage. 

We  need  to  give  more  explicit  attention  to  that  focusing  stjge, 
and  to  the  import  n.  ••  it  plays  in  the  final  solution.  Anal  vs  is , 
alter  all,  does  nothing  more  than  to  flesh  out  the  logical 
implications  of  the  focusing  stage,  so  it  is  the  focusing  stage 
which  really  determines  the  eventual  conclusions.  Alternative 
ways  of  looking  at  problems  should  be  encouraged,  and  we  should 
not  be  too  anxious  to  prune  down  to  a  single  "best."  We  should 
keep  clear  that  the  model  is  not  the  problem,  the  map  is  not  the 
terrain.  This  must  he  recognized  as  having  operational 
t.onse.juences ,  not  just  as  a  truism  to  which  to  pay  lip  service  on 
t  l.i  w  jy  to  claiming  that  the  results  must  be  true  because  "'.lie 
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analysis  says  so."  We  need  to  treat  models  differently,  and  to 
encourage,  if  not  require,  more  careful  judgmental  interpretation 
of  results. 

We  need  to  encourage  the  development  of  judgment,  and  look 
for  ways  to  train  and  sharpen  it.  This  can  be  done,  and  indeed, 
has  been  a  traditional  part  of  the  military  profession  for 
centuries.  (At  least  it  was  until  we  began  to  denigrate  judgment 
and  discourage  its  use  in  favor  of  quantitative  methods.)  We  must 
acknowledge  judgment  and  intuition  as  the  ultimate  sources  of 
understanding  about  squishy  and  ill-defined  problems,  not  as 
second  rate  substitutes  to  be  used  only  till  something  better 
comes  along.  We  must  also  recognize  that  good  judgment  is  the 
result  of  experience,  intelligence,  and  hard,  careful  thought, 
not  top-of-the  head  opinion  that  anyone  can  give  on  any  subject 
anyt ime . 

We  must  particularly  encourage  the  development  of  broad 
substantive  professionals,  knowledgeable  about  the  substance  of 
the  problems  they  address  as  well  as  about  the  methodologies  they 
bring  to  those  problems.  The  synthesis  I  called  for  earlier  can 
be  brought  about  only  by  such  professionals,  because  it  requires 
an  intuitive  gestalt  for  both  substance  and  method.  We  must 
acknowledge  the  necessity  for  substantive  understanding  and 
experience,  and  avoid  excessive  faith  in  method  alone. 

The  bottom  line,  perhaps,  is  the  question  of  responsibility, 
and  of  where  the  responsibility  for  conclusions  and  decisions 
lies.  Method  oriented  lpproacues  appear  to  tike  responsibility, 
by  attributing  to  the  problem  in  .  1  m>  t  i  ve  re  i;  ; :  y  ltd  se..;;  : :  g  to 
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provide  an  objective  solution.  The  analyst  is  simply  an 
impersonal  agent  uncovering  what  is  already  there,  and  the 
decisionmaker  who  follows  his  advice  is  simply  acting  on  that 
"objective"  solution. 

My  view  suggests  that  the  analyst  bears  a  much  greater 
personal  responsibility  for  any  conclusions  reached,  and  the 
decisionmaker  tor  my  decision  taken  on  the  basis  of  those 
conclusions.  That  responsibility  may  be  uncomfortable ,  but  it  s 
there  and  cannot  be  ignored.  People  generally  make  better 
decisions  when  they  acknowledge  their  responsibility  than  when 
they  have  some  external  agent  (The  "objective"  answer!  to  which 
they  can  shift  it.  What's  involved  is  what  Pirsig  (197*1  called 
"quality,"  and  the  importance  of  how  people  feel  about  what  they 
do. 

I'm  calling  some  very  basic  premises  into  question,  and 
asking  for  some  fundamental  changes  in  extant  attitudes  about 
knowing  and  responsibility.  These  changes  bring  no  guarantees  of 
success,  because  they  rely  on  inherently  fallible  human  judgment. 
But  method  is  fallible  too,  and  I  think  we've  got  a  better  chance 
in  the  long  run  if  we  acknowledge  that  and  move  toward  a  real 
synthesis  of  method  and  subjective  human  judgment.  In  our 
infatuation  with  methodology  and  technique  we  sometimes  forget 
that  the  human  mind  is  the  best  general  purpose  problem  solver 
yet  devised  --  honed  and  tested  against  a  wide  range  of  problems 
and  environments  across  3  million  years.  It  may  not  be  perfect, 
but  it's  well  ahead  of  whatever 's  running  second,  and  we  Tumid 
be  looking  for  ways  to  exploit  it  and  assist  it,  rathe;  time 
trying  to  replace  it  w  i  t !.  pi  enures  ind  formal  meti  ;■  1 


-26- 


REFERENCES 


1.  Strauch,  Ralph  E.,  A  Critical  Assessment  of  Quantitative 

Methodology  as  a  Po 1  icy  Ana lys is  Tool, 

The  Rand  Corporation,  P-5282,  August  1974. 

2.  Strauch,  Ralph  E.,  The  Operational  Assessment  of  Risk:  A 

Case  Study  of  the  Pueb lo  M iss ion , 

The  Rand  Corporation,  R-69 1 -PR .March  1971. 

3.  Strauch,  Ralph  E.,  The  Real  ity  W ithin :  Exploring  the  I, in 

Between  Perception  and  Real i ty , 

Book  manuscript  in  preparation  (forthcoming). 

4.  Pirsig,  Robert  M.,  Zen  and  the  Art  of  Hotorcyc  le  Ma intena 

Bantam  Books,  Inc.,  New  York,  1975. 


